Papers with inference engine
Generative Text Modeling through Short Run Inference (2021.eacl-main)
Copied to clipboard
| Challenge: | Latent variable models for text capture global semantic and syntactic features when trained correctly. |
| Approach: | They propose a short run dynamics for inference that initializes from the prior distribution of the latent variable and runs a small number of Langevin dynamics steps guided by its posterior distribution. |
| Outcome: | The proposed model is able to generate coherent sentences with smooth transition and shows no sign of posterior collapse. |
Analytical Reasoning of Text (2022.findings-naacl)
Copied to clipboard
Wanjun Zhong, Siyuan Wang, Duyu Tang, Zenan Xu, Daya Guo, Yining Chen, Jiahai Wang, Jian Yin, Ming Zhou, Nan Duan
| Challenge: | Existing models with implicit reasoning ability struggle to solve analytical reasoning of text. |
| Approach: | They propose an approach to analyze text and use it to perform reasoning over it. |
| Outcome: | The proposed approach outperforms pre-trained models on an analysis of the Law School Admission Test dataset. |
Self-training Reduces Flicker in Retranslation-based Simultaneous Translation (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing approaches to reduce flicker in simultaneous translation have increased the latency through masking and specialised inference, thus losing the simplicity of the approach. |
| Approach: | They propose to train a machine translation system to reduce flicker by controlling monotonicity and biased beam search to achieve the same flicker-latency tradeoff. |
| Outcome: | The proposed approach reduces flicker by controlling monotonicity while maintaining similar translation quality to the original. |
Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive human-like performance across various reasoning tasks, but their mastery of underlying inferential rules falls short of human capabilities. |
| Approach: | They propose a logic scaffolding inferential rule generation framework to construct an infer- ential rule base, ULogic, comprising both primitive and compositional rules across five domains. |
| Outcome: | The proposed model improves the ability to generate accurate, complex and abstract conclusions and premises and improves various commonsense reasoning tasks. |
Prune as You Generate: Online Rollout Pruning for Faster and Better RLVR (2026.acl-long)
Copied to clipboard
Haobo Xu, Sirui Chen, Ruizhong Qiu, Yuchen Yan, Chen Luo, Monica Xiao Cheng, Jingrui He, Hanghang Tong
| Challenge: | Reinforcement Learning with Verifiable Rewards (RLVR) has improved reasoning capabilities of Large Language Models (LLMs). |
| Approach: | They propose an online pruning method that prunes rollouts while steering correct ones to enhance learning signals. |
| Outcome: | The proposed method improves average accuracy by +2.30 to +2.99 across GRPO and DAPO on Qwen-3 and LLaMA-3.2 models. |
Bridging Perception, Memory, and Inference through Semantic Relations (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies suggest that it is impossible to learn meaning from surface form alone. |
| Approach: | They propose to develop triadic systems that combine neural and symbolic methods to provide a seamless information flow between them. |
| Outcome: | The proposed systems combine the strengths of neural and symbolic methods to achieve a seamless information flow between them. |